Click any tag below to further narrow down your results
Links
A detailed critique of Jensen Huang's Ezra Klein podcast appearance, where the Nvidia CEO contradicts himself on AI capabilities while simultaneously calling for extreme safety measures and dismissing existential risks—all while wielding significant influence over U.S. AI policy.
- Huang doesn't believe AI can become fundamentally different from software or pose existential risks, yet advocates for spending most R&D budgets on safety, verification, and testing—a position that only makes sense if he secretly fears the risks he publicly denies.
- His claim that AI will create net job growth relies on magical thinking: he expects a new generation of "AI-native" workers to emerge in two years and somehow all become startup founders, ignoring that most people won't start companies and that AI use in schools is already degrading basic skills like math.
- Huang wrongly attributes manufacturing job losses to outsourcing rather than automation (research shows 70-80% were technology-driven), and offers no mechanism for bringing those jobs back—just assertion that production will return to America while jobs won't.
AI researchers have spent two decades seriously arguing that superintelligent AI could kill everyone, and this isn't a PR stunt — it's a genuine belief that shapes how they work. The author explains what they think could happen and why they keep building AI anyway.
- AI researchers use the term "p(doom)" to discuss extinction probability and have been publishing on this since at least 2008, making it an established part of AI safety culture, not a recent panic.
- Multiple plausible kill mechanisms exist: engineered bioweapons, triggering nuclear war through military AI systems, robot takeover, or unforeseen methods from a superintelligence we can't predict.
- The "race dynamics" problem: if superintelligent AI is inevitable, being first might be the only way to ensure it's aligned with human values, which creates a perverse incentive to build faster rather than safer.
Rigorous models of the distant future inevitably produce extreme outcomes rather than mundane ones, because when you run any consistent logic far enough, the world either reaches a stable endpoint or crashes—and stable endpoints in a post-human future look radically different from today.
- Qualitative models (like "AI gets smarter faster than humans") can show you the direction of change but not timing, forcing you to extrapolate to logical endpoints that seem implausible.
- Quantitative models work well for near-term prediction but break down over long timescales, so forecasters must instead ask what stable state a system converges to rather than what happens at a specific date.
- The only meaningful stable states for civilization are either transformative superintelligence scenarios (Matrioshka brains, uploaded minds, von Neumann probes) or civilizational collapse—there's no middle ground when you follow the logic to its conclusion.